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Abstract 

Quantization problems suggest that the category of symplectic manifolds and symplec- 
tomorphisms be augmented by the inclusion of canonical relations as morphisms. These 
relations compose well when a transversality condition is satisfied, but the failure of the 
most general compositions to be smooth manifolds means that the canonical relations do 
not comprise the morphisms of a category. 

We discuss several existing and potential remedies to the nontransversality problem. 
Some of these involve restriction to classes of lagrangian submanifolds for which the 
transversality property automatically holds. Others involve allowing lagrangian "objects" 
more general than submanifolds. 

1 Introduction 

This paper is based on two lectures given at the Geometry Summer School at the Istituto 
Superior Tecnico in Lisbon, in July of 2009. We describe several ongoing efforts to build cat- 
egories whose objects are symplectic manifolds and whose morphisms are canonical relations. 
The lectures also included a discussion of categories whose hom-objects are symplectic man- 
ifolds, with the composition of morphisms a canonical relation, but we do not include that 
topic in this paper. 

The material presented here is based on the work of many people, including the au- 
thor's work in progress with Alberto Cattaneo, Benoit Dherin, Shamgar Gurevich, and Ronny 
Hadani. 



1.1 Canonical relations as morphisms in a category 

A canonical relation between symplectic manifolds M and N is, by definition, a lagrangian 
sub manifold of M x N, where N is N with its symplectic structure multiplied by —1. For 
example, the graph of a symplectomorphism is a canonical relation, as is any product of 
lagrangian submanifolds in M and N. 
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In his work on Fourier integral operators, Hormander [12], following Maslov |15j . observed 
that, under a transversality assumption, the set-theoretic composition of two canonical re- 
lations is again a canonical relation, and that this composition is a "classical limit" of the 
composition of certain operators. 

Shortly thereafter, Sniatycki and Tulczyjew [21j defined symplectic relations as isotropic!]] 
submanifolds of products and showed that this class of relations was closed under "clean" com- 
position (see Section [2] below) . They also observed that the natural relation between a sym- 
plectic manifold and the quotient of a submanifold by the kernel of the pulled-back symplectic 
form is a symplectic relation. 

Following in part some (unpublished) ideas of the author, Guillemin and Sternberg [9] 
observed that the linear canonical relations (i.e., lagrangian subspaces of products of symplectic 
vector spaces) could be considered as the morphisms of a category, and they constructed a 
partial quantization of this category (in which lagrangian subspaces are enhanced by half- 
densities. The automorphism groups in this category are the linear symplectic groups, and 
the restriction of the Guillemin-Sternberg quantization to each such group is a metaplectic 
representation. On the other hand, the quantization of certain compositions of canonical 
relations leads to ill-defined operations at the quantum level, such as the evaluation of a delta 
"function" at its singular point, or the multiplication of delta functions. 

The quantization of the linear symplectic category was part of a larger project of quantizing 
canonical relations (enhanced with extra structure, such as half-densities) in a functorial way, 
and this program was set out more formally by the present author in |24j and [22]. It was ad- 
vocated there that canonical relations should be considered as the morphisms of a "category" , 
and that quantization should be a functor from there to a category of linear spaces and linear 
maps, consistent with some additional structures. The word "category" appears in quotation 
marks above because the composition of canonical relations can fail to be a canonical relation, 
as will be explained in detail below, so we do not have a category. Briefly, there are two 
problems. 

• The composition of two canonical relations may fail even to be a manifold. 

• In the linear symplectic category, where each space of morphisms has a natural topology 
as a lagrangian grassmannian manifold, the composition operation is discontinuous. 

These two problems are both related to the possible failure of a transversality condition. It 
is in general hard to remedy this by imposing conditions on individual canonical relations which 
are significantly weaker than local invertibility, though we do present in Section [5] below such 
a condition which yields a category whose objects are germs of symplectic manifolds around 
lagrangian submanifolds. Otherwise, we must do something more drastic, using objects more 
general than canonical relations as the morphisms in our category, or modifying the notion of 
category itself. 

lr The calculus of coisotropic relations does not seem to have been introduced until much later, in |27j . 
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We begin this paper with a general discussion of the category in which the morphisms 
are arbitrary relations between sets. We then take a first look at the composition of linear 
and nonlinear canonical relations and at reduction by coisotropic submanifolds of symplectic 
manifolds. Next, we present a simple idea of Wehrheim and Woodward [30J, who embed the 
canonical relations in a true category SYMP in what is in some sense the optimal way. Then 
we describe the category of microfolds [3], whose objects are germs of symplectic manifolds 
around lagrangian submanifolds. At this point, we are already outside the setting in which the 
morphisms are maps between sets, but we go even further in the next section by describing 
the construction by Wehrheim and Woodward [30] of a 2-category of which SYMP could be 
thought of as the "coarse moduli space". After that, we review and extend an idea of Sabot 
|18j . who deals with the discontinuities of the composition of linear canonical relations by 
forming the closure of the graph of the composition operation. The result is a multiple- valued 
operation whose graph is an algebraic subvariety of a product of Grassmann manifolds. Finally, 
we attempt to unify and extend the examples above by using the language of simplicial spaces, 
in which categories and groupoids appear as objects satisfying special "Kan conditions" (see, 
for example, [21]). For each of the remedies above, we briefly discuss the quantization of the 
resulting structure. 

Acknowledgments. I would like to thank my hosts in the group, Analyse Algebrique, at 
the Institut Mathematique de Jussieu (Paris), where this paper was written. I would also like 
to thank John Baez, Christian Blohmann, Ralph Cohen, Benoit Dherin, Dan Freed, Dmitry 
Roytenberg, Graeme Segal, Katrin Wehrheim, Chris Woodward, and Chenchang Zhu for help- 
ful suggestions. 

2 Relations and their composition 

We begin with the category REL whose objects are sets and for which the morphism space 
REL(X, Y) is simply the set of all subsets of X x Y. We consider each such relation / as a 
morphism to X from Y. Linear [affine] subspaces of vector [affine] spaces form a subcategory 
of REL. 

The natural exchange mappings X x Y — > Y x X define a contravariant transposition 
functor from REL to itself. 

For any relation to X from Y, X is the target and Y the source. The image f(Y) of / 
under projection to X is the range of /, and the image / t (AT) C Y is the domain of /. / is 
surjective if its range equals its target, and cosurjective if its domain equals its source (i.e. 
if it is "defined everywhere"). For any y G Y, f(y) denotes the image of / on {y}, i.e. the 
subset {x eX\(x,y) G /} of X. 

The composition / o g of / G REL(X, Y) with g G REL(Y, Z) is 

{(x,z)\3y G Y such that(x,y) G / and (y,z) G g}. 

It is useful to think of this as the result of a sequence of three operations: first, form the 
product fxgCXxYxYxZ; second, intersect it with X x Ay x Z, where Ay is the 
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diagonal in Y x Y, to obtain the fibre product / Xy g; third, project this intersection into 
X x Z. 

When X and Y are manifolds and / is a (locally closed) submanifold of X x Y, f is a 
smooth relation. When / £ REL(X, Y) and g £ REL(Y, Z) are smooth, the pair (/, 5) is 
transversal if / x g is transversal to X x Ay x Z, so that their intersection / Xy 5 is again a 
manifold. A transversal pair is strongly transversal, and we will write f(hg, if the projection 
map from / Xy g to X x Z is an embedding onto a locally closed submanifold, in which case the 
image fog is again a smooth relation. When a pair is not strongly transversal, its composition 
may fail to be a submanifold, so the smooth relations do not form a subcategory of REL. 

A pair (/, g) of linear or affine relations is transversal if and only if the domain of / is 
transversal to the range of g as subspaces of Y, in which case the pair is necessarily strongly 
transversal. In particular, fftig whenever / is cosurjective or g is surjective. Transversality of 
smooth (/, g) is detected by the same criterion, applied fibrewise to the tangent relations Tf 
and Tg. If / is the graph of a smooth mapping to X from Y, then f(bg is a transversal pair for 
any smooth relation g to Y from Z. Similarly, if g is the transpose of the graph of a smooth 
mapping from Y to Z, then f(bg for every smooth relation / to X from Y. In particular, the 
category of smooth manifolds and smooth mappings is a subcategory of REL. 

There is a condition weaker than transversality which, together with an embedding con- 
dition, still insures that the composition of two smooth relations is again smooth. The pair 
(f,g) is clean if the fibre product / xy g is a submanifold of X x Y x Y x Z, and if the 
natural inclusion of T(f xy g) in the fibre product tangent bundle Tf x-py Tg is an equality 
(equivalently, if T(f o g) = Tf o Tg), and if the differential of the projection from / Xy g to 
X x Z has constant rank. If this projection is a submersion onto a locally closed submanifold 
of X x Z, then / o g is again a smooth relation, and the pair (/, g) is immaculate. For 
example, any composable pair of linear or affine relations is immaculate. 

When X, Y, and Z are symplectic manifolds, C = X x Ay xZisa coisotropic submanifold 
of X x Y x Y x Z, and the leaves of the characteristic foliation are connected components 
of the fibres of the projection from C to X x Z. It follows that, for canonical relations, the 
constant rank condition in the definition of a clean pair follows from the other conditions. For 
any transversal pair, the projection from / Xy g to X x Z is an immersion. 

Finally, we note that any (lagrangian) submanifold L of a (symplectic) manifold X may be 
thought of as a smooth (canonical) relation to X from a point or to a point from X. Although 
points are neither initial nor terminal objects in our categories of relations, they still play a 
special role. For instance, the composition of L to a point from X with V to X from a point 
is nonempty if and only if L is disjoint from V . Upon quantization, a point usually becomes 
the scalars C, and the intersection of two lagrangian submanifolds represents geometrically 
the inner product of quantum states to which they correspond. 
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3 Canonical relations and coisotropic reduction 



There are several connections between canonical relations and the reduction of symplectic 
manifolds by coisotropic submanifolds. 

3.1 The linear case 

We begin with the linear case, though much of what we write here applies immediately to the 
case of manifolds. (See the following section for further details.) 

If C is a coisotropic subspace of a symplectic vector space X, the quotient Xc of C by the 
kernel C ± of the induced bilinear form carries a natural symplectic structure and is called the 
reduced space. It is connected to X by the canonical relation 

r c = {(x,y) e X c x X\y G C and x = [y]}, 

where [y] is the equivalence class of y modulo C^. The composition of rc with a lagrangian 
subspace L in X (a linear canonical relation to X from a point) gives the reduced lagrangian 
subspace Lc = (In C)/{L n C^) in Xc- The composition is transversal, hence strongly 
transversal, exactly when L is transversal to C. We will refer to "transversal reduction" 
in this situation. The operation Lag(Xc) <— Lag(A) given by composition with rc will be 
denoted by Rc- 

For any linear canonical relation / G REL(A, Y), the range and domain are coisotropic 

f d 

subspaces of X and Y respectively, and / induces an isomorphism Xjt^ Y ) Yf(x) between 
the reduced spaces, giving a natural factorization 

/ = r )(Y) ° /red ° r/tpf) 

of any linear canonical relation as the (transversal!) composition of a transposed reduction, a 
symplectomorphism, and a reduction. In particular, any surjective linear canonical relation is 
essentially a reduction, and any cosurjective one is essentially a transposed reduction. 

The composition of linear canonical relations is itself an instance of reduction As we have 
already mentioned in the previous section, X x Ay x Z is a coisotropic subspace of XxYxYxZ, 
and 

(X X Ay X Z) L = {Ox} X Ay X {Oy}, 

so (X x Y x Y x Z)xxA Y xZ is naturally isomorphic to X x Z. Under this isomorphism, the 
composed relation is the reduction of the product / x g, and the composition is transversal if 
and only if the reduction is. 

3.2 The nonlinear case 

We turn now to the case of manifolds. Any coisotropic submanifold C of a symplectic manifold 
X carries a characteristic distribution TC 1 - C TC which is, by definition, the kernel of the 
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pullback to C of the symplectic form on X. TC consists of the values of hamiltonian vector 
fields whose hamiltonians vanish on C and is always an integrable distribution, hence tangent 
to a foliation which we will denote by C^. If C 1 ' is simple in the sense that its leaves are the 
fibres of a submersion, then the leaf space Xc = C/C 1 - is again a symplectic manifold, and 
the reduction operation 

rc = {(x,y) eX c x X\x = [y],y G C}, 

where [y] is the leaf of C 1 - containing y, is a canonical relation to Xc from X. 

Let ire be the projection from C to Xc- For any lagrangian X C C (a canonical relation 
to X from a point), the composition rc o L = rc(L) is just the reduction Lc = nc(L H C). 
The composition is transversal when L is transversal to C, in which case the restriction of ttc 
to L n C is an immersion onto Lcs but it is not necessarily injective. Furthermore, if L is not 
transversal to C, then LdC may not even be a manifold. There, a reduction operation Rc to 
lagrangian submanifolds of Xc from the lagrangian submanifolds of X is not just discontinuous 
as in the linear case, but not even defined everywhere. 

4 The Wehrheim- Woodward category 

Wehrheim and Woodward [30] begin with the following construction to circumvent the problem 
of bad compositions. (Our terminology and notation throughout this section differ somewhat 
from theirs.) The result is in some sense the minimal way to produce a category whose 
morphisms include all of the canonical relations. 

Definition 4.1 The Wehrheim- Woodward category SYMP is the category whose objects are 
symplectic manifolds and whose morphisms are generated by the canonical relations, subject 
to the relation that the composition of f and g in SYMP is equal to the composition in REL 
when f(\)g. 

More explicitly, as in [30] . we may begin with the category whose objects are symplectic 
manifolds and whose morphisms are sequences ■■■,/?•) of canonical relations which are 
composable in REL. We also include an empty sequence for each object, which functions 
as an identity morphism. Composition is given by concatenation of sequences. Set-theoretic 
composition of relations defines a functor from this category to REL. 

Now introduce the smallest equivalence relation which is closed under composition from 
both sides, for which (/, g) is equivalent to fg when (/, g) is a strongly transversal pair, and for 
which each empty sequence is equivalent to the graph of the identity map on the corresponding 
object. The equivalence classes are the morphisms in SYMP, and the composition functor 
above descends to give a functor from SYMP to REL. It follows that distinct canonical 
relations, considered sequences with a single entry, give distinct morphisms in REL. The 
identity morphisms are the (equivalence classes of the) diagonals Ay C Y x Y. A morphism 
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in SYMP is called a generalized lagrangian correspondence in [30], and a generalized 
lagrangian correspondence to X from a point is a generalized lagrangian submanifold. 

SYMP is characterized by the universal property that any map <3? to any category C 
from symplectic manifolds and canonical relations such that <£(/ o g) = <1>(/)<I> (g) whenever 
f(hg factors uniquely through SYMP. It is thus tempting to think of SYMP as a universal 
quantization category. On the other hand, quantization of canonical relations by operators 
on function spaces requires enhancement of the morphisms by some extra structure, such as 
half-densities or half-forms. Thus, it is natural to try to extend SYMP and its variants by 
building larger categories with forgetful functors to SYMP. It will also be important to 
extend to such categories the basic operations on canonical relations, such as transpose and 
cartesian products. 

The construction of SYMP is merely the beginning of what Wehrheim and Woodward 
do in [30]. Imposing topological conditions (involving Chern classes, Maslov classes, etc.) on 
the symplectic manifolds and canonical relations they define a certain subcategorjo SYMP' 
of SYMP whose objects are "admissible" symplectic manifolds and whose morphisms are 
generated by "admissible" canonical relations. For each admissible manifold X, they construct 
a Donaldson- Fukaya category Don"(X) whose objects are generalized lagrangian submanifolds 
in X and whose morphism spaces are Floer cohomology groups. Composition of morphisms 
involves counting pseudoholomorphic curves. For each admissible relation / to X from Y, they 
construct a functor Don"(/) to Don"(A) from Don"(Y) such that, when (f,g) is a strongly 
transversal pair, the functors Don"(/ o g) and Don"(/) o Don" (5) are naturally equivalent. 
Don" then extends to a functor from SYMP' to the category whose objects are categories and 
whose morphisms are natural equivalence classes of functors. Since the target category of this 
functor has an additive structure, we may view Don" as a kind of "quantization" of SYMP'. 

We will continue our discussion of SYMP' and its quantization in Section El 

5 Cotangent lifts and symplectic micromorphisms 

There is a natural but quite limited collection of symplectic manifolds and canonical rela- 
tions which form a subcategory of SYMP. It is the image of a contravariant functor T* 
from the category MAN of smooth manifolds and smooth maps. Namely, for every smooth 
manifold M , T*M is its cotangent bundle with the canonical symplectic structure, and for 
every smooth mapd eft : X — > Y, T*<p is its cotangent lift, defined as the canonical relation 
{((x,(T<j))*(ri)),(i(x),r)))\x G X and rj € T* (x) Y} to T*X from T*Y. As a manifold, T*f 
may be identified with the pulled back vector bundle <ft*T*Y over X. It is also the image 
of the conormal bundle to the graph of (ft under the symplectomorphism from T*(X x Y) to 
T*X x T*Y given by reversing the sign of cotangent vectors to Y. (A slightly different version 
of this map is called the Schwartz transform in [I].) It is easy to check that T* embeds MAN 

2 Actually, there are two categories, one for exact symplectic manifolds and one for monotone ones. 
3 Note that the arrow here goes from left to right 
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as a subcategory T*MAN of SYMP (in particular, that composition of cotangent lifts is 
always strongly transversal. 

It turns out that we can isolate a property of cotangent lifts which makes their compositions 
transversal, and then we can look for more general situations where this property is satisfied. 
Remembering that the pair (T*M, Zm), with Zm the zero section, is the local model for any 
pair consisting of a symplectic manifold and its lagrangian submanifold, we make the following 
definition. 

Definition 5.1 Let (X, A) and (Y,B) be pairs consisting of a symplectic manifold and a 
lagrangian submanifold. A canonical relation f to X from Y is liftlike with respect to A and 
B if there is a smooth map <f> : A — > B such that 



where Tf is the tangent bundle of f considered as a submanifold ofTX xTY , hence a relation 
to TX from TY . 

Every cotangent lift is liftlike with respect to the zero sections, and the composition of 
liftlike relations is always transversal near the relevant lagrangian submanifolds, but in order 
to get a category, we must localize around those submanifolds. (The use of the prefix "micro" 
below is meant to correspond to its use by Milnor [IT] in the term "microbundle".) 

Definition 5.2 A manifold pair consists of a manifold M and a closed submanifold A C M . 
Two manifold pairs (M, A) and (N, B) will be considered equivalent if A = B and if there 
is a manifold pair (U, A) such that U is an open subset in both M and N simultaneously. 
A microfold is an equivalence class [M,A] of manifold pairs (M,A). The (well defined) 
submanifold A is the core of [M, A] . 

Note that we require equality of neighborhoods and not merely diffeomorphism for two 
manifold pairs to be equivalent. 

Most of the standard constructions on manifolds carry over to microfolds. In particular, 
a submicrofold of a microfold [M, A] is a microfold [N, B] such that N C M and B C A. 
and the product [M, A] x [N, B] is [M x N,A x B] A relation between two microfolds is just 
a submicrofold of their product. It is (the graph of) a map [M, A] <— [N, B] if it has a 
representative which is a map. This makes the microfolds into a category MIC. There is a 
natural forgetful core functor [M, ^4] i — ^4 and a cross section thereof A i— > [A, A] (with the 
obvious actions on morphisms). 

Definition 5.3 A symplectic microfold is a microfold [M, A] together with a germ of sym- 
plectic structure on M for which A is lagrangian. [T*A, A] with the canonical symplectic 
structure on T*A is the cotangent microbundle of A. A symplectic micromorphism 



/(*>) 
Tf(v) 



_1 (6), forallb£B, 
{T<j)Y l {v), forallveT b B. 
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to [M, A] from [N, B] is a lagrangian submicrofold of [M, A] x [N, B] having a representative 
which is liftlike with respect to A and B. The associated map (p : A — > B is the core map of 
the micromorphism. 

By design, any composition of symplectic micromorphisms is transversal, so the symplectic 
microfolds and micromorphisms form a category MICSYMP. A symplectic micromorphism 
is a map if and only it is invertible; these maps are just the symplectomorphisms in the micro 
world. A basic result in [23] is (without the microfold terminology) that every symplectic 
microfold is symplectomorphic to the cotangent microbundle of its core. Thus, the restriction 
of MIC to the cotangent microbundles is a full subcategory containing the image of the functor 
T* : MAN — > MICSYMP, but with many more morphisms. There is also a forgetful functor 
COREMICSYMP -> MAN. 

The category MICSYMP, or rather its extension by a category of enhanced micromor- 
phisms, carrying half-densities, should be quantized by a functor to a category of semiclassical 
Fourier integral operators. What we have so far [4] is a category FOUR whose objects are 
manifolds and whose morphisms are certain operators between smooth half-densities on these 
manifolds which are formal series in a parameter K. There is a "wavefront" functor from 
FOUR to MICSYMP (in fact, to the subcategory whose objects are cotangent microbun- 
dles) for which the inverse image of the identity morphism over the cotangent microbundle of 
a manifold A is an algebra of semiclassical pseudodifferential operators on A. This functor lifts 
to a principal symbol functor which attaches a half density to the wavefront of any operator. 
What is missing is a total symbol calculus which can be make a symbol functor injective. Also 
missing is a construction of operators from general symplectic micromorphisms which are not 
acting on cotangent bundles. Even for cotangent bundles, the total symbol construction and 
its inverse appear to depend on extra structure, such as connections or local coordinates. The 
latter allow one to represent symplectic micromorphisms by generating families which serve as 
phase functions for the explicit construction of the kernels of operators as oscillatory integrals. 
The general problem seems is somewhat reminiscent of that of passing from local deformation 
quantizations of Poisson manifolds [Hj to global ones, as in [5]. Perhaps some of the methods 
of the latter paper will be helpful. 

Finally, we note that monoidal objects in the category MICSYMP are essentially local 
symplectic groupoids in the sense of [26J and correspond to Poisson manifolds. The construc- 
tion of such objects in the formal and analytic categories was carried out in [2] and [6] using the 
"tree-level" part of the Kontsevich star product. A good quantization theory for MICSYMP 
should produce algebras from these monoidal objects. 

6 The Wehrheim- Woodward 2-category 

In the remaining sections, rather than restricting the nature of our canonical relations, we 
extend the notion of what a category should be. We begin by returning to the linear case. 
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The second version of Wehrheim and Woodward's quantization follows the "groupoid phi- 
losophy" that, given an equivalence relation on a set S, one should always try to replace it by 
the finer structure of a category whose objects are the elements of S and whose isomorphism 
classes are the equivalence classes. SYMP' thus becomes a 2-category. In fact, recalling that 
any morphism f in SYMP'(J, Y) is a generalized lagrangian submanifold in X x Y, we may 
define the 2-morphism space SYMP'(f, g) to be the Floer cohomology group which comprises 
the morphism space to f from g in Don"(X x Y). 

Similarly, for the category of categories which is the target of Don", rather than simply 
identifying natural equivalence classes of functors, it is appropriate to introduce the 2-category 
structure in which the natural equivalences become 2-morphisms. Wehrheim and Woodward 
now assign to each Floer cohomology class in SYMP'(f, g) a natural transformation to Dom(f) 
from Don"(g) in such a way that they obtain a 2-functor from the 2-category SYMP' of (ad- 
missible) symplectic manifolds, generalized canonical relations, and Floer cohomology classes, 
to the 2-category of categories, functors, and natural transformations. 

The paragraphs above are merely a schematic description of a tour de force of symplectic 
topology using the authors' theory (see [28] and [29]) of "quilted pseudoholomorphic curves". 
These are, roughly speaking, piecewise pseudoholomorphic curves satisfying "seam" conditions 
along smooth (real) curves separating the smooth pieces of the domain. But each piece of the 
curve maps to a different manifold, with the seams constrained by canonical relations. 

7 Composition of linear canonical relations as a rational map 

As was mentioned in the introduction, the composition of linear canonical relations is not 
continuous. For example, if L\ and L 2 are lagrangian subspaces of X, then {L\ x L 2 ) o [L 2 x 
Li) = h\ x L\. If L\ and L 2 are transversal, then L\ x L 2 is the limit as a — > of the 
graphs r a = {(T a x,x)} of the symplectomorphisms T a defined by T a x = a~ l x for x € L\ and 
T a x = ax for x G Li- Similarly, L 2 x L\ is the limit of T a -i. The compositions T a o T a -i are 
all equal to the diagonal T± and hence so is their limit, but the composition of the limits is 
L\ x L 2 . 

In a paper about spectral analysis on fractal graphs, Sabot ]18]introduced, in the special 
case of the composition of linear symplectic reductions with lagrangian subspaces, a con- 
struction which "fills in" the discontinuities of the composition operation on linear canonical 
relations. Composition now becomes multiple valued, just as a discontinuous step function 
on the line becomes multiple valued if the gaps in its graph are filled in with vertical line 
segments. 

What follows below comes from Sabot's construction applied to general compositions, using 
the fact (see Section [3]) that composition is also a special case of reduction. (We save the details 
for a future article.) Although we mostly have the case of vector spaces over M. in mind, Sabot 
works over C. In view of the possible more general applications to finite fields suggested by 
[TO] and [UJ , we will carry out as much as possible of the construction over an arbitrary field 
k. 
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For symplectic vector spaces X and Y over k, let Sxy denote the grassmannian (a manifold 
when k is R or C) of all lagrangian subspaces of X x Y . For three spaces, X, Y, and 
Z (not necessarily distinct), composition of linear canonical relations is a mapping Mxyz '■ 
Sxy x Syz — > Sxz- The restriction of this mapping to the transversal pairs is continuous, 
with graph 

Txyz = {(fxY, fyz, fxz)\fxY^fyz and Jxy ° fyz = fxz} C Sxy x Syz x 5xz- 

Tvyz is dense in the graph of Mxyz, but its closure Txyz in Sxy x 5yz x Sxz contains 
more. Sabot's description of Txyz in the case of symplectic reduction extends to general 
compositions as follows. 

For for a composable pair (fxy, fyz), we measure their failure to be transversal by the 
deficiency d(fxy,fyz), defined as the codimension of (fxY x fyz) © (X x Ay x Z) in 
X xY xY x Z , which is also the dimension of the intersection (fxY x /yz)n({0x} x Ay x {0^}). 

Theorem 7.1 When k is M or C, Txyz an algebraic variety consisting of all triples 
(fxY, fyz, fxz) for which the codimension of fxz H fxY ° /yz wi fxY ° /yz *s ai most 
d(fxY, fyz)- Txyz is the set of its regular points. 

We may think of Txyz as the graph of a "continuous multiple valued function" Mxyz 
whose value on (fxy, fyz) is a subvariety fxy • fyz of Sxz containing the usual composition 
fxy /y z • It is perhaps worth noting that the subvariety fxy • fyz is a higher Maslov cycle 
in the sense of |7j. When k is an arbitrary field, we may take Theorem 17.11 as a definition of 
Txyz and this multiple valued composition operation 

Functions like Mxyz given by relations which are the closure of graphs of smooth maps 
are known as "rational maps" [8). The next step (work in progress) is to make the operation • 
into the composition operation in a category LINSYMP whose objects are symplectic vector 
spaces, but which is "enriched over" a category RAT whose objects are algebraic varieties and 
whose morphisms are rational maps. In other words, the morphism spaces in LINSYMP will 
be the grassmannians of canonical relations, but the composition operations will be rational 
maps. 

Remark 7.2 Although the morphisms in RAT itself are relations, the composition operation 
there is not that of REL, but rather the operation which assigns to rational maps / and g 
the closure of their set theoretic product. To have the composition defined at all, one needs to 
assume that the rational maps are "dominant" in the sense of having dense range. This raises 
the further complication that certain parts of the structure, in particular the inclusion of the 
units, cannot be dominant. It begins to appear that making RAT into a category suitable 
for defining internal categories involves issues similar the ones we have been dealing with for 
symplectic categories. The only way out may be the simplicial approach described in Section 

E 



n 



As noted in the introduction, quantization of linear symplectomorphisms is not without 
its problems. Although Guillemin and Sternberg [9\ show how to quantize symplectic vector 
spaces and to associate operators to canonical relations carrying half-densities, these operators 
may be unbounded and cannot always be composed. In fact, the undefined compositions of 
operators correspond precisely to nontransversal compositions of canonical relations. A simple 
example is the operator on "functions" on K which assigns to each u the product of it(0) with 
a delta function at 0. This operator, which is a quantization of L x L , where L is the fibre 
over in T*K, cannot be composed with itself. 

The discussion above suggests that we should try to modify the target category for the usual 
quantization, either by introducing a composition of operators which is multiple valued, or by 
looking at a category whose morphism spaces, while identified with spaces of linear operators, 
themselves admit "rational maps" which may not be defined (or may be multiply-defined) on 
individual operators. 

Remark 7.3 The "completion" of the composition of canonical relations to something larger 
also occurs in the microlocal theory of sheaves [13J . 

Remark 7.4 Segal [20J suggests another approach to building and quantizing a well-behaved 
category of linear canonical relations. For any symplectic vector space (X,u) (which could 
be a product Y x Z), the positive lagrangian subspaces L of the complexification Vq (with 
symplectic structure extend from V by complex bilinearity) are those for which iu(v,v) > for 
all nonzero v £ V. Positive canonical relations are always transversally composable, and their 
composition is smooth. They do not quite form a category, since the identities are missing, 
but they may be added "by hand". Quantization of this category (with the objects enhanced 
by metaplectic structure and the morphisms enhanced by half-forms) may be done without 
any obstructions. Taking the real limit remains a problem, though. 

Remark 7.5 It would be interesting to see how the linear theory extends to lagrangian affine 
subspaces of symplectic affine spaces. The hermitian line bundles of geometric quantization 
may play a more important role here. 

8 The simplicial picture 

The structure of a category C can be encoded in that of a simplicial object N(C) called its 
nerve. We recall (see for example [19], [31], or any book on homological algebra) that a 
simplicial object is a collection of objects S k (k = 0,1,2,...) in some base category (such 
as sets, topological spaces, or manifolds) together with, for each k, k + 1 face morphisms 
S k — > S k ~ l and k + 1 degeneracy morphisms S k — > S k+1 satisfying the composition laws of the 
generators of the category of order-preserving mappings among the sets E n = {0, 1, . . . , n}. 
The elements of S° are sometimes called vertices and those of S 1 edges. In N(C), the vertices 
are the objects of C and the edges are the morphisms, with the faces of a morphism being its 
target and source, and the degeneracy operator taking each object to its identity morphism. It 
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is convenient to write for N k {C). The composition of morphisms is encoded in C^ 2 \ whose 
elements are the composable pairs (f,g), with the face operators taking each such pair to /, 
fg, and g, while the degeneracy operators take / to pairs with an identity morphism appended 
to one side or the other. The rest of the structure is determined by this part, with being 
the composable /c-tuples, face operators given by the composition of pairs of adjacent entries or 
elimination of the entry on one end or the other, and degeneracy operators by the insertion of 
identities. The associative and identity axioms are equivalent to the compatibility conditions. 

A simplicial topological (possibly discrete) space S has a geometric realization \S\ which 
is obtained from the disjoint union of S k x Af, for all k, where is the usual fc-simplex, by 
gluing them together using rules derived from the face and degeneracy operators. The usual 
cohomology of \S\ is called the cohomology of the simplicial space. For instance, if S is the 
nerve N(G) of a group G, \N(G)\ is a model for the classifying space BG, and its cohomology 
is the group cohomology of G. 

Not every simplicial object comes from a category or groupoid. The ones that do are 
characterized by so-called "horn-filling conditions", the simplest of which require that a pair 
of edges with a common vertex be tillable (perhaps in a unique way) by a 2-simplex of which 
they are faces. By weakening these conditions, one arrives at generalizations of the notions of 
category and groupoid, as in [31]. 

Let us now apply this idea to the composition of linear canonical relations. For simplicity, 
we limit our attention to linear canonical relations from a fixed symplectic vector space X to 
itself. These form a monoid, i.e. a category E(X) with one object, and we form the usual nerve 
in which E^- k \X) is the cartesian power Lag(X x X) k . Although each E^(X) is a topological 
space, and even a smooth manifold, E'(X) is not a simplicial topological space because the 
boundary operators are discontinuous. 

The first way to build a simplicial space out of this one is based on the construction of 

Wehrheim and Woodward described in Section Within each E^- k \X), there is an open dense 

ffcl 

subset Efa (X) of "completely transversal" sequences, namely those for which the composition 
fx o . . . o ff. is transversal in the sense that Lx X . . . X is transversal in (X x X) k to the 
multidiagonal X x (Ax) k ~ l x X. It is not hard to show that this collection of subsets is 
invariant under the boundary and degeneracy operators, and that the restricted operators are 
smooth, making of E^{X) a simplicial manifold. 

Other constructions might be based on Sabot's multiple-valued composition. The simplest 
one would be to take the closures of the graphs of composition on the E^(X) defined in 
Section [7] above, but it is not clear that these form a simplicial object. It may also be useful 
to consider structures in which there is a whole family of 2-simplices whose edges are a pair 
(Li,L2) of nontransversely composable relations and an element of Lx • L2. In any case, it 
should be possible to have the face and degeneracy operators be ordinary mappings of varieties 
rather than rational maps, since the multiple-valuedness of composition is incorporated in 
the definition of the spaces of simplices. Associativity may be taken into account through 
identification of some simplices, or through the introduction of extra higher simplices. 

To quantize these simplicial versions of the symplectic category (more precisely, enhance- 
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ments thereof), one will need to look for similar simplicial structures derived from the compo- 
sition of unbounded operators on function spaces. This is essentially the point of view taken in 
|16j . Since the Floer cohomology classes which give 2-morphisms in the 2-category described 
in Section [6] are themselves equivalence classes of cochains, Mau, Wehrheim, and Woodward 
replace the Donaldson category attached to any admissible symplectic manifold by a Fukaya- 
type A°° category. To any admissible canonical relation they attach an ^4°° functor, and to 
any Floer cocycle between such relations a natural transformation of ^4°° functors, in a way 
which is compatible with composition of strongly transversal pairs, up to homotopy of A°° 
functors. 
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